Tools for Empirically Analyzing Ai Programs
نویسندگان
چکیده
The paper describes two separate but synergistic tools for running experiments on large Lisp systems such as Artiicial Intelligence planning systems, by which we mean systems that produce plans and execute them in some kind of simulator. The rst tool, called Clip (Common Lisp Instrumentation Package), allows the researcher to deene and run experiments, including experimental conditions (parameter values of the planner or simulator) and data to be collected. The data are written out to data les that can be analyzed by statistics software. The second tool, called Clasp (Common Lisp Analytical Statistics Package), allows the researcher to analyze data from experiments by using graphics, statistical tests, and various kinds of data manipulation. Clasp has a graphical user interface (using Clim, the Common Lisp Interface Manager, Version 2.0) and also allows data to be directly processed by Lisp functions. Clip and Clasp form the foundation of a larger set of specialized tools we are building for the empirical analysis of AI programs.
منابع مشابه
Position Paper for AAAI 2006 Fellows Symposium
Computational modeling using AI techniques has long been urged as a tool for empirically investigating issues of interest to non-AI domain experts in a variety of fields, such as biochemistry, medicine, law, ethics, and philosophy. AI, it was hoped, would add tools to domains already susceptible of scientific methods, or introduce scientific methodologies to domains that never had them. When th...
متن کاملAnalyzing Mathematical Programs Using MProbe
Just as modern general-purpose programming languages (e.g. C++, Java) are supported by a suite of tools (debuggers, profilers, etc.), mathematical programming languages need supporting tools. MProbe is an example of a suite of tools supporting a mathematical programming language, in this case AMPL. MProbe includes tools for empirically estimating the shape of nonlinear functions of many variabl...
متن کاملParallelism in AI Programs
A folk theorem is developing which suggests that parallel solution of AI programs wil l not afford a speedup of more than one order of magnitude. We critically review this folk theorem by analyzing some of the problems used to "prove" i t , and then cite work that provide examples of better than one order of magnitude improvement for these problems. We examine two representative AI algorithms w...
متن کاملThesis: Strategies and analysis techniques in functional program optimization
This paper abstracts the contents of the Ph.D. dissertation which has been recently defended by the author. Functional programs are commonly modelled by term rewriting systems. The execution of such programs often gives rise to useless, dangerous, and inefficient evaluation sequences which must be avoided in order to improve their computational behaviour. The thesis presents novel methods and t...
متن کاملEye on the Prize
goal the invention of computer programs having the general problem-solving abilities of humans. Along the way, a major shift of emphasis developed from general-purpose programs toward performance programs, ones whose competence was highly specialized and limited to particular areas of expertise. In this article, I claim that AI is now at the beginning of another transition, one that will reinvi...
متن کامل